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A METHOD OF ENLARGING THE TM AGE FIELD OF A FOCAL 

PLANE ARRAY CAMERA 

CROSS-REFERENCE TO RELAT ED APPLICATIONS 
[0001] The present application claims priority under 35 U.S.C. § 119 of 
German Patent Application No. 102 59 667.0, filed on December 18, 2002, the 
disclosure of which is expressly incorporated by reference herein in its entirety. 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0002] This invention relates to a method of enlarging an image field of a 
camera, such as a focal plane array camera. The image field, which consists of N 
pixels, is produced by combining scanned partial images which each consist of 
n pixels. The invention also relates to apparatuses for carrying out the method. 

2. Discussion of Background Information 

[0003] In order to record a large image field at high resolution using a camera, 
such as a focal plane array camera, it is necessary to use a detector, with a 
correspondingly large number of elements (pixels). This results in high costs, 
particularly with use of an IR detector. Alternatively, the large image field can be 
assembled from a plurality of smaller images which are displaced in relation to 
each other. This necessitates a "step-scan" mechanism, by which the optical axis 
is displaced from individual image to individual image but remains fixed during 
the recording time. This can be problematic, particularly with cameras which are 
mounted on a moveable platform for alignment. The step-by-step movement 
produces unwanted torque effects which can have an unfavorable effect on the 
alignment. Moreover, the step-by-step movement is associated with increased 
energy consumption. 

[0004] A scanning principle has been employed in, for example, J.M. Lloyd, 
Thermal Imaging Systems, 1975, Plenum Press, N.Y. by using two rotating, 
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refractive prisms. By suitably selecting the angle of deflection and the velocities 
of rotation, different scanning patterns can be created, which include, amongst 
others, an astroid pattern proposed according to the present invention. In the past, 
similar scanning patterns (cycloids) were employed for recording a 2-dimensional 
image field by an individual detector or a detector array. 

ST IMMAR Y OF THF. INVENTION 
[0005] In contrast, what is proposed according to the present invention is that 
an image which is already two-dimensional is used instead of an individual 
detector point or a detector array line, and that a reversal of movement at the 
vertexes of the astroid is used in order to keep the blurriness or unsharpness due 
to the scanning process below the size of a pixel during a recording time of an 
individual image. 

[0006] The present invention provides a method which produces a "step scan" 
by scanning elements which are moved continuously. 

[0007] The implementation of the step-scan method with the aid of 
continuously rotating prisms according to the invention simplifies the electronic 
triggering of the scanner or camera, reduces energy consumption, reduces the heat 
dissipated during scanner operation, and prevents the occurrence of periodic, 
unwanted torque effects. These advantages are particularly important for the use 
in vehicles, such as for example the scanner in homing heads comprising swivel- 
and-tilt platforms used in missiles. 

[0008] One aspect of the present invention is a method of enlarging the image 
field of a focal plane array camera, wherein the image field, which consists of N 
pixels, is produced by combining scanned partial images which each consist of 
n pixels. The method is characterized in that a cycloidal scan pattern, which is 
in the form of an astroid, is formed with the aid of at least two continuously 
rotating refractive prisms. The number of vertexes of the astroid outline, which 

2 



BEST AVAILABLE COPY 



P2464S.S02 



correspond to the points of reversal of the scanning movement, corresponds to the 
number of partial images. The reversal of movement at the vertexes of the astroid 
outline is used in order to keep the unsharpness, due to the scanning process, 
below the size of a pixel during the recording time of an individual image. 
[0009] One aspect of the present invention is directed to a method of enlarging 
an image field of a camera by combining partial images. This includes 
continuously rotating at least two refractive prisms to form a cycloidal scan 
pattern. The cycloidal scan pattern having points of reversal of scan movement 
that corresponds to a number of vertexes of the cycloidal scan pattern and to a 
number of partial images. Furthermore, in the method, the cycloidal partem is a 
astroid pattern with a plurality of vertexes and the camera is a focal plane array 
camera. Additionally, the image field comprises N pixels and the partial images 
comprise n pixels and such that the partial images overlap to form a combined 
image. The reversal of movement at the vertexes of the astroid pattern reduces 
unsharpness to less than a size of a pixel during a recording time of an individual 
image. Furthermore, the point of reversal occurs substantially in a midpoint of 
the recording time of the individual images. The method also includes producing 
four partial images using the astroid pattern and combining the four partial 
images. The combined partial images overlap. The method further includes 
projecting at least one alignment mark in to a region of overlap of the individual 
images, measuring a shift between partial images by an image processor, and 
assembling the partial image based on the measured at least one alignment mark 
to form a combined image. With this method, either limiting the projection of the 
at least one alignment mark to a few scanning cycles, or making the projection of 
the at least one alignment mark is permanent is provided. Finally, the at least one 
alignment mark is projected into an edge region of the combined image. 
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[0010] Another aspect of the present invention relates to a method of enlarging 
the image field of a camera by combining images. This method includes 
continuously rotating at least two refractive prisms such that an optical axis of the 
at least two prisms scans in a cycloidal pattern, and, capturing a plurality of 
images. The cycloidal pattern is formed as an astroid pattern with a plurality of 
vertexes. Further in the method, a number of the vertexes of the astroid pattern 
corresponds to points of reversal of the optical axis scan movement and 
corresponds to a number of partial images that are combined. The method also 
sets forth that the reversal of movement at the vertexes of the astroid pattern 
reduces unsharpness to less than a size of a pixel during a recording time of an 
image. Additionally, the method includes setting a recording time of the partial 
images such that the points of reversal are substantially in a midpoint of the 
recording time. Finally, the method can include four partial images that are 
combined using the astroid pattern which has four vertexes. 
[0011] Yet another aspect of the present invention relates to a apparatus having 
a first optical element that is configured to rotate about an axis and a second 
optical element that is configured to rotate about the axis. The apparatus further 
includes a camera that captures a plurality of images. Finally, the first optical 
element and the second optical element form an optical axis that follows a 
cycloidal pattern. In the apparatus the cycloidal pattern is in the form of an 
astroid pattern and the astroid pattern has a plurality of vertexes. The apparatus 
also has an image processor that determines the position of the projected 
alignment marks. Furthermore, the apparatus camera captures each of the 
plurality of partial images during a time that a center of the optical axis is at the 
vertex of the pattern. 
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[0012] Other exemplary embodiments and advantages of the present invention 
may be ascertained by reviewing the present disclosure and the accompanying 
drawing. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] The present invention is further described in the detailed description 
which follows, in reference to the noted plurality of drawings by way of non- 
limiting examples of exemplary embodiments of the present invention, in which 
like reference numerals represent similar parts throughout the several views of 
the drawings, and wherein: 

[0014] Figure 1 is a schematic illustration of the assembly of the overall image 
from four individual partial images; 

[0015] Figure 2 is a schematic illustration of the construction of a camera 
arrangement which is employed for carrying out the method according to the 
invention; 

[0016] Figure 3 shows the course of the rays in the two oppositely rotating 
prisms; 

[0017] Figure 4 is a schematic illustration of the production of the scanning 
pattern; 

[0018] Figure 5 shows the scanning pattern as at parametric representation; 
and 

[0019] Figure 6 is a representation for calculating the image blur. 

DETAILED DESCRIPTION OF THE PRESENT INVENTION 
[0020] The particulars shown herein are by way of example and for purposes 
of illustrative discussion of the embodiments of the present invention only and are 
presented in the cause of providing what is believed to be the most useful and 
readily understood description of the principles and conceptual aspects of the 
present invention. In this regard, no attempt is made to show structural details of 
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the present invention in more detail than is necessary for the fundamental 
understanding of the present invention, the description taken with the drawings 
making apparent to those skilled in the art how the several forms of the present 
invention may be embodied in practice. 

[0021] Figure 1 is a schematic illustration of the assembly of the overall image, 
which comprises 456 x 456 pixels, for example, and which is formed by 
combining four individual images 1 - 4, each of which comprises 256 x 256 
pixels. The distance between the image centers is 200 pixels. Thus, there is an 
area of overlap that is 56 pixels wide in each case. The four images are captured 
when an optical axis is positioned at or about the vertexes of an astroidal scanning 
movement S. The manner in which the movement S is produced is described 
below. Also shown in figure 1 are four positions R' that are alignment marks for 
aligning the images. These can be provided in the edge region of the areas of 
overlap of the individual images. In a central area of the overlap there is provided 
a temporary alignment mark R for adjusting the overall image. It should be 
understood that it would be within the spirit and scope of the present invention 
to use any number of pixels and with any amount of pixel overlap. Additionally, 
the combining of the partial images may be accomplished without the use of the 
alignment marks. 

[0022] Figure 2 is a schematic illustration of the construction of a camera 
arrangement and associated structure which is employed for carrying out the 
method. The arrangement includes a camera 1, in front of which there are two 
optical deflection elements 2 for deflecting the optical axis and thus a viewing 
direction of the camera 1 . The camera can include a charge coupled device 
(CCD) or a infrared (IR) detector, for example only. An apparatus 3 is employed 
for the projection of alignment marks. Furthermore, the apparatus can include an 
image processor, not shown, that can combine the images with the alignment 
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marks. It should be understood that it would be within the spirit and scope of the 
present invention to use any number of deflection elements 2 in order to provide 
the desired scanning pattern. 

[0023] Next, Figure 3 shows the course of the rays or optical axis that is 
created by the two optical deflection elements. The optical deflection elements 
can take the form of two prisms A and B. In the present method the two optical 
deflection elements are continuously rotated at angular velocities w A and co B 
about a common axis of rotation. The optical axis of the system is deflected 
corresponding to the position of rotation of the prisms. 
[0024] Figure 4 shows the deflection of the viewing direction due to the 
cooperation of the two prisms during a quarter-cycle from scanning position 1 to 
scanning position 2 through the scanning movement S of the optical axis. The 
left column shows the radial position of the prism B, the center column shows the 
radial position of prism A, and the right column shows the resulting deflection of 
the optical axis through the vector summation of the optical deflection of prism 
A and the optical deflection prism B. The following relationships are applicable 
to the complete scanning pattern: 

Prism deflection angle: a A = 3-a B 

Maximum total deflection angle: a,™ = 4-oc B 

Velocity of rotation: oo A =-l/3-o) B 

[0025] The deflection angle at prism B depends on the angle at which the 
optical axis meets the prism. This angle of impingement is very small so that the 
following derivations are a good approximation. More specifically, only the 
points of reversal of the scanning movement are important for the description 
of the method because they are points at which the images are captured. 
[0026] The parametric representation of the scanning pattern shown in Figure 
5 is described by: 
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x = 3a-cos cot + a-cos 3cot 
y = 3a-sin cot - a-sin 3ot 

where a is a scaling factor for the deflection angle. 

Expansion into a series about t 0 = 0 (corresponding to point "3") gives: 

x = 3cr(l. - 0.5 o>¥) + a-(l - 4.5 art 2 ) 

= 4a - 6a wV 
y = 3a-a)t-3a-(ot + 0(a)t) 3 

= 0(cot) 3 

[0027] For example, when the scanning speed approaches zero at t 0 = 0; for 
|t 0 | « 1, the scanning speed on one axis increases with the square oft and on the 
other axis it increases with t 3 . The same principle applies to each of the corner 
points or vertexes of the scanning pattern. It follows that for a scanning pattern 
which is rotated by 45° from the orientation shown in Figure 5 to the orientation 
of figure 1, a rectangular overall image can be assembled from four rectangular 
individual images. 

As shown in Figure 6, the image blur at to = 0 can be approximately calculated 
with: 

x = x 0 - Sx = 4a - 6a q 2 St 2 
where 6x = 6a a) 2 St 2 
Setting x 0 = 4a gives 
6x = (3/2) x 0 co 2 St 2 

Setting L = v/2x 0 ; 0) = 2n/T per = rc/(2At); and St = t int /2 gives 
Sx = 3k 2 /(32n/2)- (t int / At) 2 . L 
= 0.65 • (t int / At) 2 • L 
In the above equations: 

Sx = magnitude of the image blur in the x direction 
St = relevant period of time for image blur 
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L = spatial mismatch between two images 
= period of rotation for the astroid outline 

At = chronological interval between two successive partial images 

t int = integration time for an image. 
[0028] During the recording time, image blur occurs along the pixel diagonals 
so that the image blur remains within a pixel. The following ratio of recording 
time to scanning time ("scanning efficiency") results from the above formula: 

8x = 0.65 • (t int / At) 2 - L < y/2 (where L is in pixel edge length units) 

t int / At < 7(2/200) = 1:10 
[0029] This results in a suitable solution for the process according to the 
invention. It should be further mentioned that, instead of the refractive prisms 
used in the example described, other suitable components can be used to deflect 
the optical axis, such as reflecting surfaces or active optical components, 
provided that the spectral region to be processed permits appropriate deflection. 
Moreover, more than two elements can optionally be used in order to produce the 
scanning movement. In addition, it is possible to make a fine adjustment of the 
optical axis by tilting the axes of rotation of the prisms. 
[0030] It is noted that the foregoing examples have been provided merely for 
the purpose of explanation and are in no way to be construed as limiting of the 
present invention. While the present invention has been described with reference 
to an exemplary embodiment, it is understood that the words which have been 
used herein are words of description and illustration, rather than words of 
limitation. Changes may be made, within the purview of the appended claims, as 
presently stated and as amended, without departing from the scope and spirit of 
the present invention in its aspects. Although the present invention has been 
described herein with reference to particular means, materials and embodiments, 
the present invention is not intended to be limited to the particulars disclosed 
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herein; rather, the present invention extends to all functionally equivalent 
structures, methods and uses, such as are within the scope of the appended claims. 
The instant abstract is neither intended to define the invention disclosed in this 
specification nor intended to limit the scope of the invention in any way. 
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